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Abstract 

>. 

, A common problem in applied mathematics is to find a function in a Hilbert space with 

prescribed best approximations from a finite number of closed vector subspaces. In the present 
paper we study the question of the existence of solutions to such problems. A finite family of 
subspaces is said to satisfy the Inverse Best Approximation Property (IBAP) if there exists a 
point that admits any selection of points from these subspaces as best approximations. We 
provide various characterizations of the IBAP in terms of the geometry of the subspaces. 
\ Connections between the IBAP and the linear convergence rate of the periodic projection 

algorithm for solving the underlying affine feasibility problem are also established. The results 
are applied to problems in harmonic analysis, integral equations, signal theory, and wavelet 
' frames. 
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1 Introduction 



A classical problem arising in areas such as harmonic analysis, optics, and signal theory is to 
find a function x G L^(M^) with prescribed values on subsets of the space (or time) and Fourier 
domains ^iHl EOl [231 [281 [361 ES] . In geometrical terms, this problem can be abstracted into that of 
finding a function possessing prescribed best approximations from two closed vector subspaces of 
L^(M'^) [38]. More generally, a broad range of problems in applied mathematics can be formulated 
as follows: given m closed vector subspaces {Ui)i<i<m of a (real or complex) Hilbert space TC, 

find X G H such that (Vi € {1, . . . , m}) PiX = Ui, (1-1) 

where, for every i € {1, • • • ,"^}, Pi is the (metric) projector onto Ui and Ui E Ui. In connec- 
tion with (jl.ip . a central question is whether a solution exists, irrespective of the choice of the 
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prescribed best linear approximations (Mi)i<i<m- The main objective of the present paper is to 
address this question. 

Definition 1.1 Let (C/j)i<j<m be a family of closed vector subspaces of Ti and let {Pi)i<i<m de- 
note their respective projectors. Then (f/i)i<i<m satisfies the inverse best approximation property 
(IBAP) if 

{^{ui)l<^<m e XT=iU^?j {3xen) (Vi e {1, . . . , m}) P,x = m. (1.2) 

Moreover, for every (tii)i<j<m G yClLiUi, we set 

m 

S{ui, . . .,Um) = f]{x en \ PiX = Ui}, (1.3) 
i=l 

and, for every i G {0, . . . ,m — 1}, 

m 

U,+ =Y,Uj, P^+ = Pu^, and Pi^ = Pu^^^- (1-4) 
j=i+i 

The paper is organized as follows. In Section [51 we first show that the linear independence 
of the subspaces (C/i)i<j<m is necessary to satisfy the IBAP, but that it is not sufficient in 
infinite dimensional spaces. The main result of Section [2] is Theorem 12. 8| which provides various 
characterizations of the IBAP. Several corollaries are derived and, in particular, we obtain in 
Proposition 12.101 conditions for the consistency of affine feasibility problems. In Section O we 
discuss minimum norm solutions and establish connections between the IBAP and the rate of 
convergence of the periodic projection algorithm for solving (jl.ip . Finally, Section[4]is devoted to 
applications to systems of integral equations, constrained moment problems, harmonic analysis, 
wavelet frames, and signal recovery. 

Remark 1.2 Since best approximations are well defined for nonempty closed convex subsets of 
Ti, the IBAP could be considered in this more general context. However, useful results can be 
expected to be scarce, even for two closed convex cones Ki and K2. Indeed, denote the projectors 
onto Ki and K2 by Pi and P2, respectively. If ki is a point on the boundary of Ki which is not 
a support point of Ki (by the Bishop-Phelps theorem [321 Theorem 3.18(i)] support points are 
dense in the boundary of Ki), then the only point x eT~L such that Pix = ki is x = ki. Therefore, 
there is no point x e TC such that Pix = ki and P2X = k2 unless /c2 = P2ki, which means that 
the IBAP does not hold. Let us add that, even if every boundary point of Ki is a support point 
(e.g., the interior of Ki is nonempty or Ti is finite dimensional), the IBAP can also trivially fail: 
take for instance Ti = Ki = [0,+oo[ x [0,+cx)[, K2 = {{f3,-(3) | ^ G M}, A;i = (0,1), and 
A:2 = (l,-1). 

Throughout, 7^ is a real or complex Hilbert space with scalar product (• | •) and norm || • ||. The 
distance to a closed afhne subspace of 7^ is denoted by ds, and its projector by Ps- Moreover, 
{Ui)i<i<m is a fixed family of closed vector subspaces of Ti with respective projectors (-Pi)i<i<m- 

2 Characterizations of the inverse best approximation property 

We first record some useful descriptions of the set of solutions to (jl.ip . 
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Proposition 2.1 Let (nj)i<i<m G X^ILif^j- Then the following hold. 

(i) S{ui,...,Um) =(XLli^i + U^^)■ 
{h) Let X e S{ui, . . . ,Um)- Then S{ui, . . . ,Um) = x + fll^i . 



Proof, (i) Let x E and i G {!,••• The projection theorem asserts that PiX = Ui <^ 



X — Ui G 44> X € Uj + U^. Hence, (II. 3p yields x S . . . , Um) ^ x G niILi('"i + ^t)- 



Let y G H. By hnearity of the operators (^i)i<i<mi ?/ G 'S'(tti, . . . , u^) <J4> (V« G {1, . . . , m}) 
Pi{y-x) = 4^ (Vi € {1,... ,m}) G C/^ ^ y G a; + fllli f^^- D 

The main objective of this section is to provide characterizations of the inverse best approxi- 
mation property. Let us start with a necessary condition. 

Proposition 2.2 Let {ui)i<i<m G (X^iC/i) \ {(0, ...,0)} be such that Y^TLi^i = 0. Then 
S{ui, . . . ,Um) = 0- 

Proof. Suppose that x G S{ui, . . . , Um)- Then, for every i £ {1, . . . , m}, Ui = PiX and therefore 
{ui\x — Ui) = 0, i.e., = (uj I x). Hence < X^^^ = (X^i^i "Ui \x) and we reach 

a contradiction. □ 

Corollary 2.3 Suppose that (C/j)i<j<m satisfies the inverse best approximation property. Then 
the suhspaces (t/i)i<j<m are linearly independent. 

As the following example shows, the linear independence of the subspaces (?7j)i<j<m is not 
sufficient to guarantee the inverse best approximation property. 

Example 2.4 Suppose that 7i is separable, let [en)n&i be an orthonormal basis of 7^, let [an)n&i 
be a square-summable sequence in ]0, +cxd[, and set (Vn G N) /« = (e2n + oine2n+i)/ + Set 
m = 2, 

Ui = span{e2n}neN, U2 = span{/„}„gN, ui = 0, and U2 = ^On/n- (2.1) 

neN 

Then [/i n C/2 = {0} and S'(ni, U2) = 0. 

Proof. By construction, (e2n)nGN and [fn)n<m are orthonormal bases of Ui and [72, respectively. 
It follows easily that [/i fi C/2 = {0}. Now suppose that there exists a vector x G H such that 
ix = ui and P2X = U2. Then the identities X^neN I ^2n)e2n = Pix = ui = imply that 

(Vn G N) (x I e2n> = 0. (2.2) 

Hence, it results from the identities X^ngNOn/n = ^^2 = P2X = "^n&i I fn)fn that 

(VnGN) a„ = (x I = ^^=(x I e2„+i). (2.3) 

Therefore, inf„gN (a; | e2n+i) = infneN \/l + = 1, which is impossible. □ 

The next result states that linear independence is necessary and sufficient to obtain an ap- 
proximate inverse best approximation property. 
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Proposition 2.5 The following are equivalent. 



(i) The subspaces (?7t)i<j<m are linearly independent. 

(ii) For every {ui)i<i<m € X^i?7i and every e S ]0,+oo[, there exists x G H such that 

max llPjX — Mill < e. (2-4) 

l<i<m 

Proof. Set V = {{Pix)i<i<m | x £ H} and let W be the orthogonal complement of V in the 
Hilbert direct sum 0™ ^ 



(ii)| Take {ui)i<i<m G and set x = ^™ ^ Uj. Then Yl'lLi i^i \ x) = Yl'iLi i^i \ Pa) = 0, 
which implies that = ^^^^ {ui | x) = 0. Hence x = and, in view of the assumption of 

independence, we conclude that (Vz € {1, . . . ,r?T,}) Ui = 0. Therefore, V is dense in U^. 



ii) ^ (i) Take (nj)i<j<m € X^if^i such that ^ ~ 0' ^ ^ l^' +oo[5 and take x £ Ti 



xf 



such that (|2.4p holds. Then X^I^i (^j I -^i^) = Z^ilLi j x) = and therefore 

m »n m m 

= ^\\u^-Pixf + 2Ke^{ui-PiX \ P,x) + ^ ||P, 

i=l j=l j=l j=l 

m m 

= Y,\\n^- P^X\\^ - Y^WP^^f 
i=l i=l 

< me^. (2.5) 

Hence, (Vz G {1, . . . , m}) = 0. □ 

In order to provide characterizations of the inverse best approximation property, we require 
the following tools. 

Definition 2.6 [ISJ Definition 9.4] Let U and V be closed vector subspaces of 7i. The angle 
determined by U and V is the real number in [0, 7r/2] the cosine of which is given by 

c(J7,y) =sup{|(x I y)| I X r\{u nv)^, y (^V r\{u r\V)^, \\x\\ < l, <!}. (2.6) 

Lemma 2.7 Let U and V be closed vector subspaces of Ti, let u £ U, let v (z V, and set 
S = {u + [/-*-) n (v + V^). Then the following hold. 

(i) Let x£S. Then S = Pjj^x + {U^ n V^). 

(ii) Suppose that \\PuPy\\ < 1 and set 

, fu = iid-PuPvrHu-Puv) 

z = u + v, where < , (2.7) 

[v = {ld-PvPu)'\v-Pvu). 

Then the following hold. 
(a) 5/0. 
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(b) z = PsQ. 



Proof, (i) As in Proposition I2.H we can write S = x + (C/"*" fl V'^). Hence, since {U + V)~ 



{U+V)^ = U^r\V^, we get 5 = x+{U^r\V^) = P^jj^^v^)^x+{U^r^V^) = Pjj:^x+{U^nV^) 



(ii) : These properties are known (see for instance [231 Item 3.B) p. 91] and [23 > Section 5 on 



pp. 92-93], respectively); we provide short alternative proofs for completeness. 



(ii)(a): Let u & U and v ^ V. Since Pjj and Py are self-adjoint, = ||(PyP(7)*|| = 

= < 1, and the vectors u and v are therefore well defined. Moreover, it follows 

from the identity u = Ylj^niPu PvY (u — Puv) that u € U and therefore that Pjju = u. On the 
other hand, the second equality in the right-hand side of (|2.7p yields 

Puv = Pu( Y,{PvPuy{v - Pvu)) 

= (Id -PuPv)-\Puv - PuPvu) 

= (Id -PuPv)-\{ld -PuPv)u - (n - Puv)) 

= u-u. (2.8) 

Thus, Pjjz = Pu(u + v) = u + Pjjv = u. Likewise, Pyv = v and Pyu = v — v, which implies that 
Pyz = Pv{u + v) = Pyu + v = v. Altogether, z e S. 



(ii)(b) As seen above, z ^ S, u £ U, and v &V. Now let x € S. As in Proposition 12. ]|(ii)| we 
can write x = z + w = u + v + w, for some w € fl V-^. Hence, ||x|p = |[2:|p -|- 2Re(lI | w) + 
2Re{v I w) + = + WwW^ > □ 

We can now provide various characterizations of the inverse best approximation property (the 
notation (jl.4p will be used repeatedly). 

Theorem 2.8 The following are equivalent. 

(i) (Ui)i<i<m satisfies the inverse best approximation property. 

(ii) (Vi G {1, . . . ,m - l})(Vni G Ui){3x e H) Ui = PiX and (Vj £ {i + I, . . . ,m}) Pjx = 0. 

(iii) (Vie {!,..., m-1}) Pi{Ui:^) = Ui. 

(iv) (Vi e {1, . . . ,m - 1}) + [/^ = n. 

(v) The subspaces (C/i)i<i<m are linearly independent and (Vi € {1, . . . ,m — l})(3 7j S ]0, +cxd[) 
'^utr\ut+ - i'^ut + • 

(vi) The subspaces ({7i)i<i<m are linearly independent and (Vi G {1, • • • irn — 1}) Ui + C/j+ is 
closed. 

(vii) The subspaces {Ui)i<i<m are linearly independent and, for every i G {l,...,m — 1}, 
c{Ui,U,+)<l. 

(viii) (Vi G {!,..., m- l})(3 7i e [l,+oo[)(Vni G f/i) ||ni|| < 7i||i^^ni||. 
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(ix) (yie {!,..., m- l})(37i G [2, +oo[)(Vx G |lx|| < 7i{\\K^x\\ + ||i^ix||). 

(x) (ViG{l,...,m-l}) mPi+\\ <1. 



Proof, (i) 



Clear. 



ii) ^ (iii) Let i G {1, . . . , m — 1}. It is clear that Pi{Uf,) C Ui. Conversely, let Ui G Ui. By 



assumption, there exists x G P|Jlj_,_]^ C/^- = such that = PiX. In other words, C/j C Pi{U^). 
Altogether, Pi{U^^) = U^. 



iii) => (iv) : Let i G {1, . . . , m — 1}. We have 



n = ut + u, = ut + p^{ut+) = ut+ U {v-Pu^v) = ut+ U ^ = t^^ + t^i- (2.9) 



v&U. 



(iv) => (v) : Let i G {1, . . . , m - 1}. We have 

n = {ut + ui-+)^ = n^ = {0}. 



(2.10) 



This shows the independence claim. Moreover, since U[~ + U,j^ = TL is closed, the inequality on 
the distance functions follows from [8, Corollaire II. 9]. 



VI 



Let i G {1, . . . , m — 1}. It follows from [8l Remarque 7 p. 22] (see also [3l Proposi- 
tion 5.16]) that + is closed. In turn, since [SI Theoreme 11.15] asserts that U^^ + U,^-^ 
is closed, we deduce that 

Ui + U~^ is closed. (2.11) 

It remains to show that Ui-^- is closed. If z = m — 1, Ui-^- = Um is closed. On the other hand, if 
z G {2, . . . , m — 1} and C/i+ is closed, we deduce from (j2.1ip that = Ui + Ui^ = Ui + Ui+ 

is closed. 



VI 



(vii) Let zG{l,...,m — 1}. Then C/j+ and Ui + ?7j+ are closed and it follows from [151 



Theorem 9.35] that c{Ui,Ui+) < 1. 



vu, 



viii) Let i G {1, . . . ,m — 1} and let Ui G Ui. Then (j2.6p yields 

= + {Ui I Pi+Ui) 

< \\P,iuif + c{Ui,Ui+)\\ui\\\\P,+Ui\\ 

< \\P,iuif + c{Ui,Ui+)\\uif. 



(2.12) 



Hence, \\P,iui\\^ > (1 - c([/„ Ui+))\\u^\\^ 



viii) => (ix) : Let zG{l,...,m — 1} and let x G 7Y. There exists 7 G [1, +00 [ such that 

< j\\PiiPiX\\ + \\Pi^x\\ 
<-f{\\Pi^x\\ + \\Pi^P,^x\\) + \\P,^x\\ 
<7||^ix|| + (l+7)||^^^x||. 



(2.13) 
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IX 



(x) : Let i S {1, . . . , m — 1} and let x ^ TC. There exists 7 G [2, +00 [ such that 
2 



\PiX\ 



\P^+P^xf + i\\P,iPx\\ + \\P,^PiX\\f 



> \\P,+P,xf + j'^\\P,xf. 



(2.14) 



Therefore \\Pi+Pix\\'^ < (1 - 7 ^)||-Pja;|p < (1 - 7 ^)||x|p. Hence < 1 and, in turn. 



\PiPi 



p* p* 



{p+py 



p+p\\ < 1. 



1)| Fix {ui)i<i<m G X™ iC/j and set (Vi G {0, . . . , m - 1} S'i = fXLi+iiui + U^). Let us 



show by induction that 

(Vi G {0,...,m-2}) Siy^0 and (Vx^ G 5^) 5, = P.+x^ + [7^. (2.15) 



First, let us set i = m — 2. Since, by assumption < 1, it follows from Lemma [2 . 71(ii) (a) 

that 5,71-2 7^ 0- Moreover, we deduce from Lemma [2^i)| that, for every Xm-2 £ 



Sm-2 - Pum-i+Un, ^rn-2 + ^ ^t) " -P(m-2)+^m-2 + ^ 



(m-2)+- 



(2.16) 



Next, suppose that (j2.15p is true for some i G {l,...,m — 2} and let Xi G Si. Then, using 
Lemma l2.7[(i)[ we obtain 



Si-i = {ui + ut) n 5i = {ui + ut) n {p^+xi + u, 



(2.17) 



Since, by assumption ||PjPj+|| < 1, it follows from Lemma l2.71(ii)(ay that Si-i 7^ 0. Now, let 
Xi-i G Si-i- Combining ()2.17p and Lemma 12.71 (i) we obtain 



(2.18) 



This proves by induction that (j2.15p is true. For i = 0, we thus obtain 5o = njLi(^i + 7^ 0. 
In view of Proposition I2.]](i)| the proof is complete. □ 



An immediate application of Theorem 12.81 concerns the area of affine feasibility problems 
HI El [ini H EH E5]- Given a family of closed affine subspaces {Si) 

i<i<m of 7Y, the problem is to 



find X G S'j. 



(2.19) 



i=l 



In applications, a key issue is whether this problem is consistent in the sense that it admits a 
solution. Our next proposition gives a sufficient condition for consistency. First, we recall a 
standard fact. 

Lemma 2.9 Let S be a closed affine subspace ofTi, let V = S — S be the closed vector subspace 
parallel to S, and let y £ S. Then S = y + V and (Vx G Tl) Psx = y + Pv{x — y). 

Proposition 2.10 Let {Si)i<i<m be closed affine subspaces ofTi and suppose that (Ui)i<i<m are 
the orthogonal complements of their respective parallel vector subspaces. If {Ui)i<i<m satisfies the 
inverse best approximation property (in particular, if any of properties (ii) - (x) in Theorem 
holds), then the affine feasibility problem (|2.19p is consistent. 
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Proof. For every i £ {1, . . . ,m}, let Cj £ Si, and set Vi = Si — Si and Ui = PiUi. Then, by 
LemmaEJl (Vi G {1, . . . , m}) Si = ai + Vi = ai + = Ui + U^. Thus, 

m m 

p|5. = f|(n. + ^^), (2.20) 

i=l i=l 

and it follows from Proposition I2.][(I)] that (|2.19|) is consistent if (f/j)i<i<m satisfies the IBAP. □ 



Remark 2.11 The converse to Proposition 12.10] fails. For instance, let Si and S2 be distinct 
intersecting lines in 7-^ = M? . Then Ui = {Si — Si)^ and U2 = {S2 — 5*2)"'" are two-dimensional 
planes and they are therefore linearly dependent. Hence, the IBAP cannot hold by virtue of 
Corollary | 



In the case of two subspaces. Theorem 12.81 yields simpler conditions. 
Corollary 2.12 The following are equivalent. 



(i) 


{Ui,U2) satisfies the inverse best approximation 


property. 


(ii) 


(Vui G Ui) S{ui,0) / 0. 




(iii) 


Pi{U^) = Ui. 




(iv) 


+ U:t = ^• 




(v) 


f/i n C/2 = {0} and (376 ]0, +oo[) djjA_^jj^ < 7 


[diji_ + 


(vi) 


[/i n f/2 = {0} and Ui + U2 is closed. 




(vii) 


UinU2 = {0} and c{Ui, U2) <1. 




(viii) 


(37 G [l,+oo[)(Vni G Ui) \\ui\\ < 7||P2"^ni|[. 




(ix) 


(37 G [2,+oo[)(Vx G n) \\x\\ < 7(||i^i^a;|| + WP^- 


x||). 


(x) 


\\PiP2\\ < 1- 





Remark 2.13 Corollary 12.121 provides necessary and sufficient conditions for the existence of 



solutions to (II. ip when m = 2. The implication (ix)=>(i) appears in [23^ Item 3.B) p. 91] 



the equivalences (vi) ^(viii) " (ix) ^(x)| appear in [23] Item l.A) p. 88], and the equivalences 



m 



(iv)m(x)] appear in [30, Lemma on p. 201]. 



As consequences of Theorem l2.8t we can now describe scenarii in which the necessary condition 
established in Corollarv 12.31 is also sufficient. 

Corollary 2.14 Suppose that the closed vector subspaces (f/i)i<i<m are linearly independent, 
that ||Pm_iPm|| < 1 and that, for every i G {1, . . . ,m — 2}, Ui is finite dimensional or finite 
codimensional. Then {Ui)i<_i<rn satisfies the inverse best approximation property. 
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Proof. In view of the equivalence (i) ^ (vii) in Theorem 12.81 it is enough to show that (Vi € 
{1, . . . ,m — 1}) c{Ui, Ui-y.) < 1. For i = m — 1, since ||PjPj_|_|| = ||Pm-i-fm|| < l, we derive from 



the imphcation (x)=>(vii) in Corollarv 12.121 that c{Ui,Ui-y.) < 1. Now suppose that, for some 



i G {2, . . . , m — 1}, c{Ui,Ui+) < 1. Using to the imphcation (vii) ^ (vi) in Corollary 12.121 we 



deduce that U, 



Ui + f/i+ is closed. In turn, since Ui^i is finite or cofinite dimensional. 



it follows from [181 Corollary 9.37] that c([/(j_i), C/(j_i)+) < 1, which completes the proof by 
induction. □ 

Corollary 2.15 Suppose that the closed vector subspaces (C/j)i<j<m are linearly independent and 
that, for every i G {1, . . . ,m—l}, Ui is finite dimensional or finite codimensional. Then {Ui)i<i<m 
satisfies the inverse best approximation property. 

Proof. Since Um~i is finite dimensional or finite codimensional, it follows from [18i Corollary 9.37] 



and the implication (vii)=>(x) in Corollarv 12.121 that ||Pm-i-fm|| < 1- Hence, the claim follows 
from Corollary 12.141 □ 

Example 2.16 Let F be a closed vector subspace of Ti and let (vj)i<i<m-i be linearly indepen- 
dent vectors such that V-^ fl span {vi}i<i<rn-i = {0}. Then, for every (r/.t)i<j<m-i G C"^~^, the 
constrained moment problem 



X G V and (Vi G {1, . . . , m — 1}) (x ] Vi 



rji (2.21) 



admits a solution. 



Proof. This is a special case of Corollarv 12.151 where Um = V , 
{l,...,m-l},Ui = span{?;j} and Ui = rjiVi/WviW^ . □ 



0, and, for every i G 



Corollary 2.17 Suppose that the subspaces (C/j)i<i<m are linearly independent and that Ti is 
finite dimensional. Then {Ui)i<:i<m satisfies the inverse best approximation property. 

The above results pertain to the existence of solutions to (jl.ip . We conclude this section with 
a uniqueness result that follows at once from Proposition I2.1|(ii)[ 

Proposition 2.18 Let (uj)i<j<m G X^ILif^i- Then (jl.ip has at most one solution if and only if 



Combining Theorem 12.81 and Proposition 12.181 yields conditions for the existence of unique 
solutions to (jl.ip . Here is an example in which m = 2. 

Example 2.19 The following are equivalent. 



(i) For every ui G Ui and U2 G U2, S{ui,U2) is a singleton. 

(ii) + U^ = n and n = {0}. 



Proof. Existence follows from the implication (iv) =^ (i) in Corollary \2.12\ and uniqueness from 
Proposition [2381 □ 
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3 IBAP and the periodic projection algorithm 



If m i<i<m satisfies the IBAP, then (jl.ip will in general admit infinitely many solutions (see 
Proposition I2.18P and it is of interest to identify specific solutions such as those of minimum 
norm. 



Proposition 3.1 Suppose that {Ui)i<i<m satisfies the inverse best approximation property, let 
{ui)i<i<m G X^if/j, and, for every i G {1, . . . , m - 1}, set 

T, : U,+ ^ [/, + Ui+ 

V ^ (ld-P^P^+y\u^-P^v) + (ld-P,+Pi)-\v-Pi+Ui). (3.1) 

Define recursively Xm = Um and (Vi € {m—1, . . . , 1}) Xj = TjXj+i . Then, for every i E {1, . . . , m}, 

m 

Xi = Ps,0, where Si = f]{uj + Uj-). (3.2) 

j=i 

In particular, xi = Ps{ui,...,u,n)^ minimal norm solution to (II. ID . 



Proof. Let i G {l,...,m — 1}. We first observe that the operator Tj is well defined since the 
in Theorem 12.81 yields ||PjPj+|| = ||Pi+Pj|| < 1. Moreover, the expansions 



(i) 




(x) 


-1 - 


- V 



(Id -PiPi+)-^ = EjmiPiPi+y and (Id -Pi+n)-^ = EjmiPi+Pi)' imply that its range is 
indeed contained in Ui + Ui+. Thus, Xi is a well defined point in Ui + = 



To prove (j3.2p . we proceed by induction. First, for i = m, since Um € Um, we obtain at once 

Xi = Um = P{u^+u^)0 = Ps,0. (3.3) 
Now, suppose that ()3.2p is true for some i £ {2, . . . , m}. By definition, 

Xi-i = (Id -Pi_iP(j_i)+)"^(ni_i - Pi-iXi) + (Id -P(j_i)+Pj_i)"^(xi - P(j_i)+Ui_i). (3.4) 



Since Xi € and G f/j-i. Lemma l2.7|(ii)(b) asserts that Xi-i is the element of minimal 

norm in (uj-i + U^^) fl [xi + U^_-^^^^). On the other hand since, by (13. 2p . Xj G nj^i('"i + ^Z)' 
we derive from (II. 4p that, as in Proposition 12.11 

(m \ -L m m 

J2Uj] =x, + f|t// = f|(n, + [//). (3.5) 
j=i / j=i j=i 

As a result, Xi-i is the element of minimum norm in 

m 

(n,_i + ^^i)nf|(^x,+t//). (3.6) 

j=i 

In other words, = P5,_iO, which completes the proof. □ 

Conceptually, Proposition 13.11 provides a finite recursion for computing the minimal norm 
solution xi to (jl.ip for a given selection of vectors (iij)i<j<m G Xj^if^j. This scheme is in 
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general not of direct numerical use since it requires the inversion of operators in (j3.ip . However, 
minimal norm solutions and, more generally, best approximations from the solution set of (jl.ip 
can be computed iteratively via projection methods. Indeed, for every r £ H and (uj)i<i<m £ 
X^iC/j, let us denote by B(r; ui, . . . , Um) the best approximation to r from 5(ui, . . . , Um), i-e., 
by Proposition I2.1i r i)[ 



B{r; ui,...,Um)= Ps{u^,...,u^)r = P^-^^^{u,+utf- (3-7) 

A standard numerical method for computing B{r; ui, . . . , Um) is the periodic projection algorithm 

xq = r and (Vn G N) x„+i = Qi • • • QmXn (3.8) 

where, for every i G {1, . . . , m}, is the projector onto Uj + , i.e., 

Qi = i^u +c/i : a; 1-^ Mi + j; - PiX. (3.9) 

This algorithm is rooted in the classical work of Kaczmarz [25] and von Neumann [39j . Although it 
has been generalized in various directions O [H [9l [15] , it is still widely used due to its simplicity and 
ease of implementation. If S{ui^ . . . , Um) 7^ 0, the sequence (x„)neN generated by ()3.8p converges 
strongly to B{r;ui, . . . ,Um)- If Ui = 0, this result was first established by von Neumann [39j for 
m = 2 and extended by Halperin [22j for m > 2. Strong convergence to B{r; tti, . . . , Um) in the 
general affine case (uj ^ 0) is a routine modification of Halperin's proof via Lemma 12.91 (see [18] 
for a detailed account). Interestingly, if the projectors are not activated periodically in (13. 8p but 
in a more chaotic fashion, only weak convergence has been established [T] and it is still an open 
question whether strong convergence holds. 

In connection with ()3.8p . an important question is whether the convergence of {xn)n&n to 
B{r;ui, . . . ,Um) occurs at a linear rate. The answer is negative and it has actually been shown 
that arbitrarily slow convergence may occur [5] in the sense that, for every sequence {an)neN in 
]0, 1[ such that | 0, there exits r £ H such that 

(VnGN) \\xn-B{r;ui,...,u„^)\\>an. (3.10) 

On the other hand, several conditions have been found [3], [5l El [171 [HI [26] that guarantee that, if 
(jl.ip admits a solution for some {ui)i<i<m £ X^if^i, then, for every r £ H, the sequence {xn)neN 
generated by (13. 8p converges uniformly linearly to i?(r; ui, ... , Um) in the sense that there exists 
a € [0, 1[ such that [l9| Section 4] 

(VnGN) \\xn- B{r-ui,...,Um)\\<a''\\r- B{r-ui,...,Um)\\. (3.11) 

The next result states that the IBAP implies uniform linear convergence of the periodic projection 
algorithm for solving the underlying affine feasibility problem (jl.ip for every (tii)i<j<m £ X^iC^j 
and every r G 7i. In other words, if ()l.ip admits a solution for every (?Xi)i<i<m G y^^iUi, then 
uniform linear convergence always occurs in (j3.8p . 



Proposition 3.2 Suppose that {Ui)i<i<m satisfies the inverse best approximation property and 
set 



a 



\ 



m—l 
i=l 

Then a G [0, 1[ and, for every r G W and every (tii)i<i<m S Xi^it^i; the sequence {xn)neN 
generated by (|3.8p satisfies (|3.1ip . 
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Proof. We first deduce from the impUcation (i) (vii) in Theorem 12.81 that (Vi G {!,... ,?7i — 1}) 



c{Ui, Ui+) < 1. Hence, it follows from ^ Theorem 9.35] that (Vi G {1, . . . , m - 1}) c(C/^, [/^) < 
1. In turn, ([XT2]) and (L^i imply that 



a 



m—l / y m \ 2\ 

\ 1- n 1-^ f^^' n e[0'i[- (3-13) 



Now let (iij)i<i<m G X^if^i. Since the IBAP holds, we have 

S{uu...,Um)^0. (3.14) 

Altogether, it follows from (f3T3]) . (IXTil) . and [H Corollary 9.34] apphed to (f/^)i<i<m that 
(f3TT|) holds. □ 

In the case when m = 2, the above result admits a partial converse based on a result of [5]. 

Proposition 3.3 Suppose that Uir)U2 = {0}, i/iai (Ui, U2) does not satisfy the IBAP, and that 
{ui,U2) G C/i X [/2 satisfies S{ui,U2) ^ 0. Let {an)neN be a sequence in ]0, 1[ such that q„ j 0. 
Then there exits r G such that the sequence (x„)„gN generated by ()3.8p with m = 2 satisfies 

(VnGN) ||x„-B(r;ni,U2)|| >an. (3.15) 



Proof. It follows from our hypotheses and the equivalence (i) ^(vi) in Corollarv 12 . 1 21 that Ui + U2 



is not closed. In turn, we derive from [S] Theorem 1.4(2)] that there exists yo (z Ti such that the 
sequence {yn)neN generated by the alternating projection algorithm 

(VnGN) yn+i = Pu^^Pu,^yn (3.16) 

satisfies 

(Vn G N) \\yn - Pij±r,u^yo\\ > a„. (3.17) 

Now let y G S{ui,U2) and set r = y + yQ. It follows from Proposition 12. that S{ui,U2) = 
y + (C/j*- n C/2"). Hence, it follows from (j3.7p and Lemma \T9\ that 

B{r;ui,U2) = y + Pu^nU^i^ - v) = V + Put^U^Vo- (3-18) 
On the other hand, xq — y = yo and, using Lemma \T9\ (13. Sp with m = 2 and (I3.18[) yield 

(Vn G N) -y = P^^^,j±P^^^^±Xn -y = Py^ut^y+ui^n -y = Pu^Pu^ i^n - y)- (3.19) 

This and (j3.16p imply by induction that (Vn G N) — y = yn- In turn, we derive from (j3.18p 
and (f3T7l) that 

(VnGN) \\xn- B{r-ui,U2)\\ = \\{yn + y) - {y + Pu^nu^yo)\\ = WVn- Pu^nu^V^W ^ (3-20) 
which completes the proof. □ 
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4 Applications 



In this section, we present several applications of Theorem 12.81 As usual, L^(M^) is the space of 
real- or complex-valued absolutely square-integrable functions on the A^-dimensional Euclidean 
space M^, x denotes the Fourier transform of a function x E L^(]R^) and suppx the support of 
X. Moreover, if A C M^, 1a denotes the characteristic function of A and the complement 
of A. Finally, fi designates the Lebesgue measure on M^, ranT the range of an operator T and 
ranT is the closure of ranT. 

The following lemma and its subsequent refinement, will be used on several occasions. 

Lemma 4.1 [21 Proposition 8], [71 Corollary 1] Let A and B he measurable subsets of M.^ of 
finite Lebesgue measure, and let x £ L^(M^) be such that xl\^y^ = and ^Iq^ = 0. Then x = 0. 

Lemma 4.2 [2, p. 264], |21l Theorem 8.4] Let A and B be measurable subsets ofMJ^ of finite 
Lebesgue measure. Set U = {x £ L'^{R^) \ xI^a = 0} and V = {x £ ^^(M^) | xI^b = O}. Then 
WPuPvW < 1. 



4.1 Systems of linear equations 



Going back to Definition ll.il we can say that (t/j)i<j<m satisfies the IBAP if for every (uj)i<j<m ^ 
X^iranPj there exists x £ H such that (Vi G {l,...,m}) PiX = Ui. As we have shown, 



this property holds if (iv) in Theorem 12.81 is satisfied, i.e., if (Vz G {l,...,m — 1}) kerPj + 



CXjLi+i ker Pj = H. In the following proposition, we show that such surjectivity results remain 
valid if projectors are replaced by more general linear operators. 

Proposition 4.3 For every i E {1, . . . , m}, let Qi he a normed vector space and let Ti: TC ^ Gi 

be linear and hounded. Suppose that 

m 

(Vi G {1, . . . , m - 1}) ker + p| ker Tj = H. (4.1) 

j=i+i 

Then, for every {yi)i<i<m G X^iranTj, there exists x G H such that 

(Vie {l,...,m}) Tix = yi. (4.2) 



Proof. For every i G {l,...,m}, let yi G ranTj, set Ui = (kerTj)-*-, and let Ui G Ui be such 
that TiUi = yi. Now let x £ TC. Then x solves (|4.2p (Vi G {l,...,m}) TjX = TjUj <^ 
(Vi G {l,...,m}) Ti{ 
PiX = 

items 



X 



Ui. 



;) = <^ (Vi G {1,... ,m}) X - lii G kerTi = Uf- (Vi G {1,... ,m}) 
We thus recover an instance problem (jl.ip and, in view of the equivalence between 
(i) and (iv) in Theorem 12. 8^ we obtain the existence of solutions to (14. 2[) if, for every 
+ U^^^ = TC, i.e., if ^ holds. □ 



iG {l,...,m-l}, 

We now give an application of Proposition 14.31 to systems of integral equations. 
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Proposition 4.4 For every i G {1, . . . ,m}, let Vi, wi, and yi be functions in L^(M^) such that 

there exists Xi G L^(M^) that satisfies f^^ Xi(s)vi{s)wi{t — s)ds = yi{t) /u-a.e. on M^. Moreover, 
suppose that there exist measurable sets (^j)i<i<m in such that 

(Vi € {1, . . . ,m}) iJ,[{Ai + suppvi) nsuppwi) = (4.3) 

and 

m 

(Vi G {1, . . . , m - 1}) U Pi Aj = M^. (4.4) 

j=i+i 

Then there exists x € L^(M) suc/i i/iai 

(Vi G {1, . . . ,m}) / x{s)vi{s)wi{t - s)ds = yi{t) ^-a.e. onM.'^ . (4.5) 



Proof. The result is an application of Proposition 14.31 in 7^ = L^(M^). To see this, denote 
by ★ the A^-dimensional convolution operator and, for every i G {1, . . . ,m} and every x £ Ti, 
set TiX = (xvi) -k Wi. Then {Ti)i<i<m are bounded linear operators from TC to 7i since, by [U 
Theoreme IV. 15], 

(Vi G {1, . . . , m}) (Vx G = IKa^^'i) *Wi\\ < \\xvi\\ii \\wi\\ < \\x\\ \\vi\\ \\wi\\. (4.6) 

Now fixiG{l,...,m — 1}. Since (j4.5p can be written as (|4.2p . Proposition 14.31 asserts that it 
suffices to show that 

m 

kei Ti+ Pi kerTj =n. (4.7) 

j=i+i 

To this end, let z G 7Y. It follows from (j4.4p that we can write z = zi + Z2, where zi =2"!^. and 
?2 = ?lcAi- have 

TjZi = [(zi^i) ★tfi]^ = {zii^Vi)wl= {{zlAj*Vi)uri (4.8) 

and 

supp ((? l^J *i?j) C supp(z1aJ +supp{rj c Ai + suppvi. (4.9) 
Therefore, we derive from (14.81) and (14.31) that 



fi{suppTiZi) = n(supp{{zlAi)-*^Vi) nsupp-Wj^ = 0. (4.10) 

This shows that zi G kerTj. Now fix j G {i + 1, . . . ,m}. Then it remains to show that Z2 G kerTj. 
Since (j4.4p yields ZAi = fy^^^_^_i A^ C Aj, arguing as above, we get 

suppTjZ2 = supp [({'zl[^j^J-kVj)uij^ C (C^j+suppiy))nsuppS7j C (^j+supp{{))nsuppS7j. (4.11) 

In turn, we deduce from (|4.3p that fj.{suppTjZ2) = and therefore that Z2 G kerTj. □ 

We now give an example in which the hypotheses of Proposition 14.41 are satisfied with m = 3. 
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Example 4.5 Let {a,/?, 7} C M and let {vi,V2,vs,wi,W2,W3} C L^(M). Suppose that < 7 < 
2a and that 

fsuppTTi C [/3,/3 + 7] , supp7r2 C [a,+oo[, suppt^j C ]-oo, -a] 

1 supp wl C [—a + /3 + 7, a + /3] , suppS^ C ]— 00, 0] , suppS?^ C [0, +00 [ . 

Now set Ai = ]—oo, —a]U[a, +oo[, A2 = [—a, +oo[, and = ]— 00, a]. Then (j4.4|) is satisfied and, 
since Ai + suppi^ C ]— 00, —a + /? + 7] U [a + /3, +oo[, A2 + suppi52 C [0, oo[, and A^ + supp-t^s C 
]-oo,0], so is ^2^1. 

Next, we consider a moment problem with wavelet frames [12 [ I13 [ [TB]. 

Proposition 4.6 Let ip he a hand-limited function in L^(IR), say supp^ C [p^p] for some p G 
]0, +oo[. Suppose that {'4'j,k){j,k)(^i?; where ipj^k - t 1— > 2^/'^il){2H — k), is a frame for L^(R), i.e., 
there exist constants a and (3 in ]0, +oo[ such that 

{MxeL\^)) a||x||2<^^|(x|V'i,fc>|'</3||xf, (4.13) 



and, moreover, that {ipj,k){j,k)£Z'2 admits a lower Riesz bound 7 G ]0,+ 



00 , i.e 



^ 2 

jez kez jez kez 



(4.14) 



Let A be a measurable subset o/M such that < p{A) < +00, let J ^"L, and set 

A = {(j,A;) G Z X Z I j < J}. (4.15) 

Then, for every function y G L'^{A) and every sequence {ilj,k)(j,k)&K ^ ^^(^)> there exists x G 
L^fM) such that 



x\a = y and (V(j, k) G A) {x \ tpj^k) = rjj^k- (4.16) 

Proof. Set H = L^(M), Gi = L'^{A), and Q2 = ^^(A), and define bounded linear operators 

Ti: H ^ Qi: x x\a and r2 : 7^ ^ ^2 : 2; 1-^ ((x | ipj,k)){j,k)eA- (4-17) 

Then ranTi = Gi and, on the other hand, it follows from [11^ Lemma 2.2(ii)] and ()4.14p that 
ranr2 = ^2- Hence, in view of (j4.16p . we must show that, for every yi G ranTi and every 
y2 G ranT2, there exists x such that Tix = yi and T2X = 7/2- Appealing to Proposition 14.31 
it is enough to show that ker Ti + ker T2 = 71 or, equivalently, that 

+ U;t = 'H, where Ui = raUT; and U2 =fEnT^. (4.18) 

Set U = {xe L2(M) I xlc^ = 0}, B = [-2-^ p,2-^ p], and V = {x e L'^{R) \ xIqb = O}- By 
Lemma l4.H U CiV = {0} and it therefore follows from [18, Lemma 9.5] and Lemma 14.21 that 

ciU,V) = \\PuPv - PunvW = WPuPvW < 1- (4.19) 
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On the other hand, it fohows from (j4.17p that T* : Gi ^ H satisfies 

'y(t), if t£A; 



(V2/Ggi)(Vt GM) iT*y)it) 



0, otherwise 



and that 



{j,k)eA 



(4.20) 
(4.21) 



Since U{j,fc)eA supp V'j.fc C B, we have 

UiCU and U2 C F. (4.22) 
Hence, [7i n C/2 = {0} and (Ii39|) yields 

c(f/i,f/2) < c([/,F) < 1. (4.23) 
in Corohary ETTll we conclude that (|4.18p holds. □ 



In view of the implication 



vn, 



IV 



4.2 Subspaces spanned by nearly pairwise bi-orthogonal sequences 

The following proposition provides a wide range of applications of Theorem 12.81 with m = 3. 

Proposition 4.7 Let (ui,A;)fceZ; {u2,k)k&, o^nd {u^^k)k& be orthonormal sequences in Ti such 
that 

(VA: G Z)(Vi G {1, 2})(Vj E {i + 1, 3})(V/ G Z \ {A;}) ± Uj- (4.24) 

Moreover, suppose that 



sup I ^i2,fc)| +SUp J|(u2,fc I ng^fc)! + SUp J | (ui^fc [ Ug^fc)] < 1. (4.25) 

feez ^ k& ^ kez ^ 

Then, for every sequences (ai,fc)fceZ) (Q;2,fc)feeZ) O'l^'d (a3,fc)fcez ^^(^)) i/iere exists x & 7i such 
that 

{yk G Z) ai^k = {x \ ui^k), a2,k = {x \ ^2,^), and a^^k = {x \ u^^k)- (4.26) 

Proof. For every i G {1,2,3}, set Ui = span {uik}^^^ and observe that (Vx G 7i) Pix = 
Ylik& I Ui^k)ui,k- Accordingly, we have to show that {Ui, 1/2,113) satisfies the IBAP. Using the 



equivalence (i)^(x) in Theorem 12.81 this amounts to showing that ||PiPi+|| < 1 and ||P2-f3|| < 1- 



First, let us fix i G {1, 2} and j G {i + 1, 3}, and let us show that 



SUp|(Mi,A; I Uj,k)\ < \\PiPj\\ < SUp|(Ui,fe | Uj^k) \ ■ 
fcgZ " " 



In view of (j4.24p . we have 



(Vx G n) PiPjX = ^ (x I Uj^i){uj^i I Ui^i)ui^i. 



(4.27) 



(4.28) 
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Hence, for every k & Z, PiPjUi^k = \{ui,k \ Uj^k)\^Ui^k and therefore ||^j-Pj|| > \\PiPjUi^k\\ = 
\{ui.k I ^j,fc)P- This proves the first inequahty in (j4.27|) . On the other hand, it follows from ()4.28p 
that 

(Vx G n) WPiPjxf = ^ |(x I Uj,i){uj^i I ni,j)p < sup\{uj,i \ u^,i)f \\xf. (4.29) 

This proves the second inequality in (j4.27p . 

Since (|4.25p and (|4.27p imply that IIP2-P3II < 1, it remains to show that |lPiPi+|| < 1. We 
derive from (f05|) and (|i?271) that 



(v'llAP2|| + \/||PlP3||)(l + vffVF^) = y/\\PlP2\\ + V\\PlP3\\-\\P2P3\\ 

+ {V\\PlP2\\ + V\\PlP3\\ + V\\P2P3\\)V\\P2P3\\ 

<1-||P2P3||- (4.30) 
For every A; € Z, let P^j^ denote the projector onto {ua^fc}"*" and set 

Pi;k'^2,k U2,k - {U2,k I U3,k)u3^k oi\ 

V2,k = TT^ 77 = , (4.31) 

11^3.^^2,^11 ^Jl-\{u2,k\us,k)f 

which is well defined since ()4.25p guarantees that |(u2,fc I ^^3,fc)| < 1- Let us note that (j4.3ip yields 

{U3,k I U2,k)v2,k {U3,k I U2,k)u2,k , \{u2,k \ U3^k)\^ U3^k 

1*3 A: . = = U3 k 2 2 

V 1 - I {U2,k I U3^k) f ' ^ " I ^''2,fc I U3,k) I 1-1 {U2,k I ^3,^) | 

~ 2 ('"3,fc - {U3,k I U2,k)u2,k)- (4.32) 



1 - K'W2,fc I 1i3,fc)l 

On the other hand, it follows from (j4.24p and (j4.3ip that {v2^k}kez U {u3^k}kez is an orthonormal 
set and that 

span {{v2,k}kez U {u3^k}kez) = span {{Pi;kU2,k}kez U {u3^k}kez) = U2 + U3 = Ui+. (4.33) 
To compute ||PiPi+||, let x G fi and let k £ Z. We derive from (j4.33p that 

Pl+X = X] I ^2,l)v2,l + U3J)U3J. (4.34) 

Hence, using (14241) . (I^STI) . and (f432]) . we obtain 

(Pl+X I = (x I V2,k){v2,k I + (x I U3^k){u3,k \ Ui^k) 

{V2,k I Ul,k) 



{X I U2,fc) 



(""3,^ I U2^k){v2,k I lil.fc) 



V \Jl- \ {u2,k I U3^k)? / 

{X I U2,fe)/3fc + (x I U3^k)lk, (4.35) 
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where 



and 



Ik 



{U2,k I Ul,k) - {U2,k I U3,k){u3,k I Ul,k) 
1 - \ {u2,k I U3,k)\^ 

{U3,k i Ui^k) - {U3,k I U2,k){u2,k I •Ml.fc) 
1 - |('U2,fc I ^i3,fe)|^ 



We note that (fOT]) yields 



1^ I ^ \{ni,k\n2,k)\ + \{n2,k\u3,k)\\{ui,k\us,k)\ ^ + V\\^^\ VW^\ 

\Pk\ S < 



1 - \ {u2,k I l*3,fc)r 



1- 



and, hkewise, 



Thus, we obtain 



1- ll^2i^3|| 



(Vx e H) ||PiPi+x|| = I ui,k)\' 



kez 



< sup + sup |7A:| ||x| 



1- ||^'2P3| 

Appeahng to (j4.30p . we conclude that ||PiPi+|| < 1. □ 



(4.36) 
(4.37) 

(4.38) 
(4.39) 



(4.40) 



Remark 4.8 A concrete example of subspaces satisfying the hypotheses of Proposition 14.71 can 
be constructed from an orthonormal wavelet basis. Take ip G L^(R) such that the functions 
{i^k,l)k€Z^^ where tpk,r- t ^ 2'^/^^(2*^t — I), form an orthonormal basis of L^(M) |16j . For every 
i G {1, 2, 3} let, for every /c e Z, {rii^k,i)i& be a sequence in i'^(Z) such that X^;^^ \Vi,k,i\'^ = 1 and 
define 

f/i = span{ui,fc}fcgz, where (VA; G Z) Ui^k = '^r]i,k,l'4'k,l- (4.41) 

Then (tii,A:)fcGZ5 {u2,k)kez, and (na^fc)^^^ are orthonormal sequences in L^(M) that satisfy (j4.24p . 
Moreover since, for every i and j in {1,2,3} and every fc G Z, (uj^fc | Uj ^) = Yliez Vi,k,iVj,k,h the 
main hypothesis (j4.25p is equivalent to 



sup 

kez \^ 



y^^m,k,ir]2,k. 



lei 



+ sup 

fcez 



'^m,k,iV3,k,i 



+ sup 

kei \ 



E 



11l,k,l'n3,k,l 



< 1. 



(4.42) 
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4.3 Harmonic analysis and signal recovery 

Many problems arising in areas such as harmonic analysis [21 [71 [2T| [23l [Ml I28j . signal theory 
[TUl [5T1 [5H] . image processing [U [3S], and optics [221 [3S] involve imposing known values of 
an ideal function in the time (or spatial) and Fourier domains. In this section, we describe 
applications of Theorem 12.81 to such problems. 

The following lemma will be required. 

Lemma 4.9 Let U, V, and W be closed vector subspaces of 7i such that W C V. Then 
WPuPwW < WPuPvW- 

Proof. Set B = {xen \ < l}. Then Pw{B) C B. In turn, since W C V, 
Pw{B) = Pv{Pw{B)) C Pv{B) and hence C Pu{Pv{B)). Consequently, \\PuPw\\ = 

sup{||P[/Pvi/2;|| I X G 5} < sup{||Pc/Pi/x|| I X € -B} = \\PuPv\\- □ 

The scenario of the next proposition has a simple interpretation in signal recovery [141135]: an 
A^-dimensional square-summable signal has known values over certain domains of the spatial and 
frequency domains and, in addition, m — 2 scalar linear measurements of it are available. 

Proposition 4.10 Let A and B be measurable subsets o/ of finite Lebesgue measure, and 
suppose that m > 3. Moreover, let (i^i)i<i<m-2 be functions in L^(M^) with disjoint supports 
{Ci)i<i<m-2 such that 

(Vi € {1, . . . , m - 2}) fi{Ci) < +00 and ^id D CA) > 0. (4.43) 

Then, for every functions Vm and Vm-i in L^(M^) and every (??j)i<i<m-2 G M™~^, there exists a 
function x E L^(M^) such that 



(Vi G {1, . . . ,m - 2}) / x{t)vi{t)dt = rji, x\a = Vm-i\A, and x\b = Vm\B- (4.44) 

JCi 

Proof. We first observe that the problem under consideration is a special case of p.ip with 

n = L'^{R^), 

[/j = span{wj} and Ui = rjiVi / WviW^ , 1 < i < m — 2; 

< Um-i = {x e 7i \ xlf^^ = 0} and Um-i = Vm-ilA] (4.45) 

Urn = {x e TC \ xIqb = 0} and ihn = V^lB- 

It follows from Lemma 14.21 that |[Pm-i-fm|l < 1- Hence, in view of Corollarv 12.141 it suffices to 
show that the closed vector subspaces (C/i)i<i<m are linearly independent. Since the supports 
iCi)i<i<m-2 are disjoint, the subspaces (C/j)i<j<m~2 are independent. Therefore, if we set U = 
Yl^i' Ui, it is enough to show that [/, Um-i, and Um are independent. To this end, take 

iy,ym.-l,ym) eU X Um-l X Um SUch that 

y + ym-i + ym = 0, (4.46) 
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and set C = \JlLi Ci. We have {y + j/m -i)lc(Auc) = 0) U C) < +00, ymlc^ = 0, and 
< +00. Hence, it follows from (j4.46p and Lemma |4. II that 



y + Vm-i = and = 0. 
It remains to show that y = 0. Since y U, there exist (ai)i 



(4.47) 



CKi^i- However, since the supports (C, 



<i<m-2 



G C™-^ such that y 



i ) l<j<m- 



_2 are disjoint, 



m-2 
i=l 



2 m— 2 



El |2|| ||2 



(4.48) 



i=l 



On the other hand, ()4.43p implies that, for every i G {1, . . . ,m — 2}, 



dnA 



\vi{t)\'^dt + 



dnGA 



\vi{t)\'^dt > 



dnA 



\Vi{t)\'^dt = \\VilA\ 



(4.49) 



At the same time, we derive from ()4.47p that y 
ylCA = 0- Consequently, (j4.48p yields 



-ym-i £ Um-i and therefore from (j4.45p that 



m-2 

E 



|2|| ||2 



hut 



m—2 2 m—2 

i=l i=l 



(4.50) 



In view of (|4.49p . we conclude that (Vi € {1, . . . ,m — 2}) = 0. □ 



Remark 4.11 In connection with Proposition 14.101 let us make a few comments on the following 
classical problem: given measurable subsets A and B of M''^ such that /i(^) > and fi{B) > 0, 
and functions a and b in L^(M^), is there a function x G L^(R^) such that 



x\a = clIa and x\b = bis ? 



(4.51) 



To answer this question, let us set 



'Ui = {x e L^{R^) \ xIqa = 0} and ui = aU, 



U2 = {xe V' 



X 



Icb = 0} ^'^'i ui = blB- 



(4.52) 



Thus, the problem reduces to an instance of (jl.ip in which m = 2. 



If /i(A) < +00 and /i(-B) < +00, it follows from Lemma 14.21 (j4.52p . and the implication 



(x) =>(i) in Corollarv 12.121 that the answer is affirmative (see also [23, Corollary 5.B p. 100]). 



If ^(C^) < +00 and /u(C-B) < +00, it follows from (j4.52p . Proposition 12.181 and Lemma [4. II 
(applied to and U^) that ()4.5ip has at most one solution. 

Suppose that A is bounded and that jJ-iCB) > 0, and let e G ]0,+oo[. Then there exists 
X G L2(M^) such that 

/ \x{t)-a{t)\'^dt+ [ |x(C) -6(e)|^dC < £• (4.53) 
J A Jb 
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To show this, we first observe that Ui (11/2 = {0}. Indeed, let y G Ui H C/2. Then y can be 
extended to an entire function on (see \3A\ Theorem 7.23] or \37\ Theorem III. 4. 9]) and, 
at the same time, ylgs = 0, which implies that y = [33l Theorem 1.3.7]. Hence, applying 
Proposition 12.51 with m = 2, we obtain the existence of x € L^(M^) such that 

- Mif + \\P2x - < e, (4.54) 

which yields (j4.53p . In the case when ZB is a ball centered at the origin and 6 = 0, 
(j4.53p provides the following approximate band-limited extrapolation result: there exists 
X € L^(M^) which approximates a on A and such that x nearly vanishes for high frequencies. 

The following example describes a situation in which the IBAP fails. 

Example 4.12 The following example is from [29]. Let C = [-1/2,1/2] x [-1/2,1/2] and set 
n = L^{C). Moreover, define 

(V(».„) e Z^) S(m,n) = / .(M)exp(-i2.(». + (4.55) 

Jc 

set A = [0, 1/2] X [0,1/2], and set B = Fu{(m,0) \m£Z}, where F is a nonempty finite subset 
of Z X Z. The problem amounts to finding functions with prescribed best approximations from 
the closed vector subspaces 

'Ui = {xen\ xlcA = 0} 

< U2 = {x £n \ x{s,t) = x{-s,t) a.e. on C] (4.56) 
U3 = {x en\ xIb = o}. 

Since + + = {0} [29], it follows from Proposition 12.181 that the problem has at most 
one solution. However, the subspaces are not independent. Indeed, given a finite subset / of Z 
such that (0, n) ^ F whenever n ^ I and complex numbers {cn)nGl, the trigonometric polynomial 

is in [72 n C/3. Therefore, in the light of Corollary 12.31 the IBAP does not hold. 



References 

[1] I. Amemiya and T. Ando, Convergence of random products of contractions in Hilbert space, Acta 
Sci. Math. (Szeged), vol. 26, pp. 239-244, 1965. 

[2] W. O. Amrein and A. M. Berthier, On support properties of L^'-functions and their Fourier transforms, 
J. Funct. Anal, vol. 24, pp. 258-267, 1977. 

[3] H. H. Bauschke and J. M. Borwein, On projection algorithms for solving convex feasibility problems, 
SI AM Rev., vol. 38, pp. 367-426, 1996. 

[4] H. H. Bauschke, P. L. Combettes, and S. G. Kruk, Extrapolation algorithm for affine-convex feasibility 
problems, Numer. Algorithms, vol. 41, pp. 239-274, 2006. 



21 



[5] H. H. Bauschke, F. Deutsch, and H. Hundal, Characterizing arbitrarily slow convergence in the 
method of alternating projections, Intl. Trans, in Op. Res., to appear. 

[6] H. H. Bauschke, F. Deutsch, H. Hundal, and S.-H. Park, Accelerating the convergence of the method 
of alternating projections. Trans. Amer. Math. Soc, vol. 355, pp. 3433-3461, 2003. 

[7] M. Benedicks, On Fourier transforms of functions supported on sets of finite Lcbcsgiic measure, J. 
Math. Anal. AppL, vol. 106, pp. 180-183, 1985. (Originally available as a preprint. Royal Institute of 
Technology, Stockholm, Sweden, 1974). 

[8] H. Brczis, Analyse Fonctionnelle Theorie et Applications, 3rd cd., Dunod, Paris 1999. 

[9] D. Butnariu, Y. Censor, and S. Reich, Eds., Inherently Parallel Algorithms in Feasibility and Opti- 
mization and Their Applications, Elsevier, New York, 2001. 

[10] C. L. Byrne, Signal Processing - A Mathematical Approach, A. K. Peters, Wellesley, MA, 2005. 

[11] P. Casazza, O. Christensen, S. Li, and A. Lindner, Riesz-Fischer sequences and lower frame bounds, 
Z. Anal. Anwendungen, vol. 21, pp. 305-314, 2002. 

[12] O. Christensen, Moment problems and stability results for frames with applications to irregular 
sampling and Gabor frames, Appl. Comp. Harm. Anal., vol. 3, pp. 82-86, 1996. 

[13] O. Christensen, Frames, Riesz bases, and discrete Gabor/wavelet expansions. Bull. Amer. Math. Sac, 
vol. 38, pp. 273-291, 2001. 

[14] P. L. Combettes, The foundations of set theoretic estimation, Proc. IEEE, vol. 81, pp. 182-208, 1993. 

[15] P. L. Combettes, Hilbertian convex feasibility problem: Convergence of projection methods, Appl. 
Math. Optim., vol. 35, pp. 311-330, 1997. 

[16] I. Daubechies, Ten Lectures on Wavelets, SIAM, Philadelphia, PA, 1992. 

[17] F. Deutsch, Rate of convergence of the method of alternating projections, in: ISNM, vol. 72, pp. 
96-107, 1984. 

[18] F. Deutsch, Best Approximation in Inner Product Spaces, Springer- Verlag, New York, 2001. 

[19] F. Deutsch and H. Hundal, The rate of convergence for the cyclic projections algorithm HI: Regularity 
of convex sets, J. Approx. Theory, vol. 155, pp. 155-184, 2008. 

[20] D. L. Donoho and P. B. Stark, Uncertainty principles and signal recovery, SIAM J. Appl. Math., vol. 
49, pp. 906-931, 1989. 

[21] G. B. FoUand and A. Sitaram, The uncertainty principle: A mathematical survey, J. Fourier Anal. 
Appl, vol. 3, pp. 207-238, 1997. 

[22] I. Halperin, The product of projection operators. Acta Sci. Math. (Szeged), vol. 23, pp. 96-99, 1962. 

[23] V. Havin and B. Joricke, The Uncertainty Principle in Harmonic Analysis, Springer- Verlag, New 
York, 1994. 

[24] P. Jaming, Nazarov's uncertainty principles in higher dimension, J. Approx. Theory, vol. 149, pp. 
30-41, 2007. 

[25] S. Kaczmarz, Angenaherte Auflosung von Systemen linearer Gleichungen, Bull. Acad. Sci. Pologne, 
vol. A35, pp. 355-357, 1937. 



22 



[26] S. Kayalar and H. L. Weinert, Error bounds for the method of alternating projections, Math. Control 
Signals Systems, vol. 1, pp. 43-59, 1988. 

[27] P. Kosmol and X. L. Zhou, The product of affine orthogonal projections, J. Approx. Theory, vol. 64, 
pp. 351-355, 1991. 

[28] J. M. Melenk and G. Zimmermann, Functions with time and frequency gaps, J. Fourier Anal. AppL, 
vol. 2, pp. 611-614, 1996. 

[29] W. D. Montgomery, Optical applications of Von Neumann's alternating-projection theorem. Optics 
Lett, vol. 7, pp. 1-3, 1982. 

[30] N. K. Nikol'skii, Treatise on the Shift Operator, Springer- Verlag, New York, 1986. 

[31] A. Papoulis, A new algorithm in spectral analysis and band-limited extrapolation, IEEE Trans. 

Circuits Systems, vol. 22, pp. 735-742, 1975. 

[32] R. R. Phelps, Convex Functions, Monotone Operators and Differentiability, 2nd ed.. Lecture Notes 
in Math., vol. 1364, Springer- Verlag, New York, 1993. 

[33] R. M. Range, Holomorphic Functions and Integral Representations in Several Complex Variables, 
Springer- Verlag, New York, 1986. 

[34] W. Rudin, Functional Analysis, 2nd cd., McGraw-Hill, New York, 1991. 

[35] H. Stark (Editor), Image Recovery: Theory and Application, Academic Press, San Diego, CA, 1987. 

[36] H. Stark, D. Cahana, and H. Webb, Restoration of arbitrary finite energy optical objects from limited 
spatial and spectral information, J. Opt. Soc. Amer., vol. 71, pp. 635 642, 1981. 

[37] E. M. Stein and G. Weiss, Introduction to Fourier Analysis on Euclidean Spaces, Princeton University 
Press, Princeton, N.J., 1971. 

[38] D. C. Youla, Generalized image restoration by the method of alternating orthogonal projections, 
IEEE Trans. Circuits Syst., vol. 25, pp. 694-702, 1978. 

[39] J. Von Neumann, On rings of operators. Reduction theory. Annals of Mathematics, vol. 50, pp. 
401-485, 1949 (a reprint of lecture notes first distributed in 1933). 

Acknowledgement: The work of the first author was supported by the Agence Nationale de 
la Recherche under grant ANR-08-BLAN-0294-02. The work of the second author was supported 
by the Creative and Research Scholarship Program of the University of the Philippines System. 



23 



